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Purchasing MBTA Procurement & Logistics 
Department 

Address 10 Park Plaza, Room 2810 


City, State Zip Code Boston, MA 02116 
Procurement Contact Mellissa O’Connor 
Person 
E-Mail Address Moconnor2@mbta.com 


1. Description or Purpose of Procurement: 


Through this Request for Information (RFI), the MBTA is seeking information 
regarding available tools for developing automated test scripts specifically for 
validating Windows Desktop Applications. The MBTA manages a variety of Windows 
Desktop Applications that are critical to our operations. These and future 
applications are each implemented using their independent technology stacks and 
may require adaptability of an automation tool that supports various technologies. 
Additionally, the robustness and efficiency of integrating this tool within an overall 
Quality Testing Framework that includes reporting and analysis of test results is an 
important consideration. 


To enhance our testing processes, we are exploring tools that can streamline the 
creation, execution, and management, and maintenance of automated test scripts. 
Our goal is to improve testing efficiency, accuracy, and overall software quality. This 
RFI aims to gather insights on potential solutions, including features, capabilities, 
and best practices for implementing automated testing within our IT environment. 


The objectives of this RFI are to: 


e Identify tools that support automated testing for Windows Desktop 
Applications. 

e Understand the features and functionalities of the proposed tools. 

e Understand integration capabilities with other development and testing 
environments. 

¢ Gather information on licensing, pricing, and support options 


2. Requested Information (RFI Response): 


Please formulate a response of not more than 20 pages. Material such as a title 
page, table of contents, and supplemental material or appendices are not included 
in that limit. 
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Response should be submitted in COMMBUYS and should address the following 
topics: 


Tool Overview 


1. Name of the tool and vendor. 
2. Description of the tool’s primary functions and features. 


Technical Capabilities 


3. Which Windows versions and development architectures are supported by 
the tool? 

4. Does the tool support automation for other platform technologies besides 
Windows Desktop Applications (e.g. Macintosh, Mobile (iOS, Android), Web 
Applications/Service)? 

5. Is there support for creating/generating performance/load tests that simulate 
many users? 

6. Which automation programming/scripting languages are supported (e.g., C#, 
Python, etc). 

7. Provide any additional technical information that distinguishes from 
competitors. 


Automation Features: 


8. Does the tool support configuration and customization? 

9. Does the tool support recording and playback of test scripts. 

10.Does the tool require access to the application source code? 

11.Can test cases and suites be executed in parallel for expanding test 
execution efficiency? 

12.Can the test be executed from a remote test controller or does the execution 
need to be triggered on the test system where the application is installed? 

13.Can the tool function without access to the internet? Please describe any 
limitations. 

14.Does the solution incorporate Al technologies and methods for improving test 
creation, maintenance, or assessment of automated tests? 


Test Data Management 


15.Is there Test Management organization of tests into test case, test suite, test 
plan? 

16.Is test case version tracking available? 

17.Does tool provide organization of automation libraries, configs, run time data, 
results, etc? 

18.How are test results saved (in a DB, exportable to a DB or other file type as 
Excel, CSV)? 
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19.Indicate any reporting capabilities that are available with the system. 
Integration: 


20.Indicate compatibility/integration with any test management/execution 
frameworks. 

21.Can the tool be integrated within a CI/CD delivery model? 

22.Describe integrations and/or compatibilities with other reporting systems. 

23.Describe any API and command line integrations that may be available. 

24.Does platform integrate LDAP or other Identity Management mechanisms for 
users? 


Installation/Operation 


25.Is the tool available as SaaS, Installed, other? 

26.Can solution be deployed in cloud environments (e.g., AWS or Azure) or 
alternatives? 

27.Provide the pre-requisites and minimum specifications for systems/hardware. 

28.Describe major steps, resource requirements, and timing needed to 
implement the system? 

29.Please describe operational availability and any limitations if loss of 
connectivity. 


Support and Maintenance: 


30.What is the fix and/or enhancement release cycle and frequency? 

31.What SLA do you support for uptime/production support/break-fix/service 
requests? 

32.Are Professional Services required/provided when installing the tool? 


Information Security 


33.Briefly describe your information security controls and processes. 

34.What types of Information Security certifications/attestations does your 
platform support/provide? 

35.Does the solution allow for managing user role permissions, and any impact 
on licensing? 

36.Describe security elements related to Data Storage (include SaaS and Cloud 
installations), Encryption (in transit, and at rest), password protocols, any 
other exposures and protections. 


Software Accessibility 


37.ISs your solution and included documentation compliant with the following: 
Web Content Accessibility Guidelines (WCAG) version 2.1, levels A and AA? If 
not, in what areas is the solution noncompliant? 


S 
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38.Does your solution have a completed Accessibility Compliance Report (ACR) 
from the latest version of the VPAT 2.1 (Voluntary Product Accessibility 
Template) or equivalent? If so, does the ACR include reporting for WCAG 2.1 
levels A and AA (AAA optional) and Functional Performance Criteria (Section 
508 requirements)? 


Financial Considerations 


39.Is your solution available through software resellers? If yes, please indicate 
the resellers that you currently work with. If no, please indicate if you would 
consider working with a reseller. 

40.Please describe your license model including types of licenses. 

41.What are your cancellation and renewal terms? 

42.|f cloud based, how is cost applied for usage time, data storage, and users 
defined? 

43.Please provide representative pricing information for your solution. Example 
scenarios below. 

a. 1 Users (include 1 Admin, 1 Test Developers, 1 Report Designers, 1 
test exec/reviewer); Execute 1000 tests per month; System Usage 
about 12 hours per day 

b. 3 Users (include 1 Admin, 3 Test Developers, 3 Report Designers, 3 
parallel test exec/reviewers); Execute 3000 tests per month; System 
Usage about 12 hours per day 

c. 8 Users (include 2 Admin, 4 Test Developers, 4 Report Designers, 8 
parallel test exec/reviewers); Execute 10000 tests per month; System 
Usage about 12 hours per day 

44.What is your model for implementation and training, and what are 
representative implementation and training costs? 

45.What additional information have we not inquired about that your company 
feels would derive business value for the MBTA? 


3. Next Steps 


Upon receipt of responses, the MBTA may request additional information or 
demonstration of system capability through email or virtual meeting. 


Responses to this RFI will be used to understand current capabilities and 
determine the merits of moving forward with a Request for Proposal (RFP). If the 
decision is to move forward, the MBTA will develop and refine business 
requirements by March 2025. Any RFP will be posted on COMMBUYS, and the 
MBTA will endeavor to notify all companies that respond to this RFI. 
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4. Procurement Calendar 


Procurement Activity Date Time 


RFI Published 20 November 4:00pm 
2024 


Deadline for Submission of 29" November 4:00pm 
Questions through COMMBUYS | 2024 
“Bid Q&A” 


Response to Questions Posted 3'* December 4:00pm 
Online 2024 


Deadline for Bidder Responses 10"°December 4:00pm 
(“Bid Opening Date/Time” in 2024 
COMMBUYS) 


Bidders are required to monitor COMMBUYS for changes to the procurement 
calendar for this Bid. 


5. Online Questions (Bid O&A) 


Written Questions must be entered by pressing the “Bid Q&A” tab for the Bid in 
COMMBUYS no later than the Questions Due date and time indicated in the 
Procurement Calendar (above). The MBTA reserves the right not to respond to 
questions submitted after this date. It is the Bidder’s responsibility to verify 
questions were successfully posted on COMMBUYS. 


Written Responses to Questions will be posted on the Bid Q&A Tab in COMMBUYS 
on or about the “Response to Questions Posted Online” date indicated in the 
Procurement Calendar (above). 


6. RFI Attachments 


List attachments here (if applicable) 


